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ABSTRACT 



This monograph provides a status report on issues related to 
accountability, including standards and assessments, data systems, and the 
role of incentives for schools, teachers, and students in improving student 
achievement. Using information gathered from the literature and interviews 
with state administrators of vocational education, this paper provides a 
picture of the progress made to date and points to future challenges . It was 
discovered that, despite some initial trepidation about the 1990 Carl D. 
Perkins Vocational -Technical Act (Perkins II) accountability requirements, 
each state has developed its own system of performance measures and standards 
and devised some sort of implementation plan. All but two states have gone 
well beyond the Perkins II requirements for accountability in vocational 
education at the secondary and postsecondary levels. The public's demand for 
excellence for all students has been the driving force behind 
standards-based, systemic reform. However, reaching consensus around what 
defines excellence has been difficult from state to state, much less 
nationally. In recent years, the development of student standards has 
extended beyond traditional academic areas to areas such as general workplace 
readiness, industry core, and job-specific skills. The research on 
accountability has established the importance of the following items in 
developing standards -driven assessment in academic, vocational -technical, and 
work readiness programs: broad public engagement in the design and 
implementation of assessments; strong political leadership; and incentives 
for students, teachers, and schools. More research and development in the 
area of incentives and consequences are needed. (Contains 20 references.) 
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Accountability Systems: 

Performance Standards and Assessment 



MIKALA L. RAHN AND PATRICIA HOLMES 

The passage of the 1990 Carl D. Perkins 
Vocational-Technical Act (Perkins II) required 
states to set up accountability systems for their 
vocational programs. As they grappled with 
the new mandates, their first concerns were 
centered around the law’s basic requirements. 
At a miriimum, they had to develop two 
measures in the accountability system. One of 
these measures had to be an indicator of 
learning and competency gains, including stu- 
dent achievement of basic or more advanced 
academic skills. The other measure could be 
one of the following four: 

(1) competency attainment; 

(2) job or work skill attainment or 
enhancement including student progress 
in achieving occupational skills necessary 
to obtain employment in the field for 
which the student has been prepared, 
including occupational skills in the indus- 
try the student is preparing to enter; 

(3) retention in school or completion of 
secondary school or its equivalent; or 

(4) placement into additional training 
or education, military service, or 
employment. 

The first requirement posed the most 
challenges. Not only did states have to find 
ways to measure academic skills, but they also 
had to measure ^gains’’ and distinguish 
between “basic” and “advanced” skills. For 
many, the task was daunting, and administra- 
tors faced many challenges: 

• Some states lacked statewide academic 
testing systems. 
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• Academic tests weren’t always adminis- 
tered at the appropriate grade level (for 
example, administered at the 9th grade as 
opposed to 11th or 12th). 

• Some states administered a test at an 
appropriate grade level, but did not 
administer it in a pre-/post model such as 
the 11th and 12th grade to measure stu- 
dent level gain. 

• The law did not specify the difierence 
between “basic” and “advanced” skills. 

• There was a general finstration with mea- 
suring academics out of context as 
opposed to a measurement of integrated 
or applied academics. 

The purpose of this CenterPoint is to pro- 
vide a status report on issues related to 
accountability, including standards and assess- 
ment, data systems, and the role of incentives 
for schools, teachers, and students in improv- 
ing student achievement. Our goal, using 
information gathered &om the literature and 
fix)m interviews with state adiniriistrators, is to 
provide a picture of the progress made to date 
and to point to future challenges. 

With the recent passage of the Carl D. 
Perkins Vocational and Applied Technology 
Education Amendments of 1998 (Perkins III), 
looking backward to go forward becomes 
critically important. The new Act requires the 
implementation of a similar accountability 
system, however, with the potential for higher 
stakes associated with implementation in the 
form of incentive perforrnance money. After 
eight years of implementing Perkins II, we 
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found that states made 
dramatic progress toward 
meaningful account- 
ability systems. The 
political context for 
measuring outcomes 
and commitment and 
sophistication of state 
administrators has 
improved over time. 
Despite this progress, 
however, states are far 
fiom developing com- 
plete accountability 
systems for vocational 
education or integrating 
these into the states’ 
overall education reform 
agenda. Major challenges 
exist that require atten- 
tion and support for 
state-level administrators 
in improving systems 
started under Perkins II 
into systems envisioned 
in the new Perkins III. 

Progress of State 
Accountability Efforts in 
Vocational Education 

In spite of some initial trepidation with the 
accountability requirements in Perkins II, each 
state developed its own system of perfor-- 
mance measures and standards and devised 
some sort of implementation plan. At the sec- 
ondary and postsecondary level, all but two 
states went well beyond the requirements of 
Perkins II and included more than two per- 
formance measures and standards. In fact, 
most states included three to ten measures 
(Hoachlander & Rahn, 1992; Rahn & Alt, 
1994). These accountability systems were 
never intended to produce data that could be 
compared nationally. Instead, the purpose was 
to give state and local educators data they 
could use to improve vocational education 
programs and courses. 

States built accountability systems suited 
to their own history and culture. For 
example, in more decentralized states, local 
education agencies were allowed to use their 
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own assessments to measure academic gains 
and to develop their own instruments on 
other measures. While in these “local control” 
states there was no comparability and litde 
standardization, there was more buy-in at the 
local level. In more centralized states, stan- 
dardized systems could use statewide 
assessments that produced more comparability 
across local education agencies, but perhaps 
less perceived use for the system at the local 
level (Stecher, Hanser, Rahn et al., 1995; 

Rahn & Alt, 1994). 

The usefulness of the Perkins II legislated 
performance measurement systems varies 
fix>m state to state. In states that integrated 
the legislative requirements with their own 
initiatives for improving vocational educa- 
tion, the systems continue to improve. But in 
states with more of a “compliance” mind set, 
the accountability systems have not evolved 
much over time. Administrators in these 
states will wait for new federal legislation 
that mandates change. 

Fortunately, most state administrators 
realize that the demand for accountability 
from the public, politicians, and others is 
here to stay, and are working hard to figure 
out what data is reasonable to collect and 
how it can be used to improve reporting 
about students and programs. The concerns 
raised are no longer “WTiy do we have to 
measure academic skills?” but “How do we 
best measure academic and occupational 
skills and assist locals in their use of data for 
program improvement?” The next sections 
will provide a progress report on the key 
areas in state accountability systems. 

Academic Standards 

The driving force behind standards- 

based, systemic reform is the public’s 
demand for excellence for all students. 
However, reaching consensus around what 
defines excellence has been difficult fix>m 
state to state, much less nationally. Once 
adopted, standards become the centerpiece 
of performance-based, systemic reform and 
accountability systems measuring progress in 
reform. The set of standards for student learn- 
ing that each state has or is adopting has been 
colored by its own particular political process 
and local educational traditions. As the effort 
to establish standards for what students should 



know and be able to do has spread, a number 
of organizations have set about evaluating the 
quality of state standards. 

hdaking Standafds Adatter, first released in 
the summer of 1995, is the American Federa- 
tion ofTeachers (AFTs) effort to compare 
the quality of academic standards fix>m state to 
state. According to the AFT, although “other 
reports have been produced over the last year 
or two discussing standards-based reforms in 
the states, our report is the only one we know 
of that analyzes the quality of the academic 
standards in every state.” To meet the AFTs 
criteria, states must have or be developing 
standards in English/language arts, math, sci- 
ence, and social studies and be clear and 
specific enough to provide the basis for a 
common core curriculum across the state. 

According to the AFT, standards-based 
reforms will be effective as levers for educa- 
tional reform only if the “standarxls are clear 
and specific enough to guide what we [teach- 
ers] do in the schools” and are “apphed 
consistendy so that no students get left 
behind.” Standards “should be the glue that 
holds the various components of the educa- 
tional system together.” Ideally, standards are 
aligned to the state s student assessment sys- 
tems and students receive additional help and 
are given incentives to reach the standards. 

Among the AFT’s major findings in its 
1997 report is that the states’ commitment to 
standards-based reform remains strong. In fact, 
all states but one are developing common 
academic standards for their students. While 
the quality has improved since the 1 996 
report, most states “still need to improve some 
of their standards in order to provide the basis 
for a common core learning,” especially in 
Enghsh and social studies. The AFT considers 
some as models for other states, most notably 
Virginia’s standards, which the AFT judged as 
exemplary” in all four core subjects. 

A companion volume to Making Standards 
Matter is the Coucil for Basic Education’s 
(CBE’s) Great Expectations? (foftus & Berman, 
1998). It responds to the recommendation 
that states bolster the rigor and international 
competitiveness of their standards. The study 
was firamed to answer the question “Arfe states 
setting high standards for student learning?” 

CBE began with math and English lan- 
guage arts and next year will examine the 



rigor of science and social studies standards. i 
According to CBE, all states but two, Iowa 
and Wyoming, have developed or are develop- j 
ing state standards. Because CBE only \ 

reviewed drafb of standards that would be I 
approved with no significant changes by Janu- j 
ary 1, 1998, several states were not included in j 
its analysis. j 

To arrive at their findings, CBE developed I 
an evaluation process with the help of two I 
advisory panels (one for each subject area) i 
made up of subject specialists, teachers, and \ 
parent and business representatives. The panels | 
worked with CBE to develop a definition of 
rigor in standards and to approve the fire- 
works and rubrics CBE used in the analysis. j 
CBE developed model standards against i 

which states were analyzed (81 standards for \ 
math and 62 for English language arts). | 

CBE concluded that while states have j 
begun to set high expectations for what stu- I 

dents should know and be able to do, the i 

rigor of these standards varies considerably. In | 
general, state math standards tend to be more \ 
rigorous than English language arts. States \ 

with low to moderate levels of rigor in math I 
tend to address most essential concepts and | 
skills, but at a lower level of sophistication \ 
than states with very rigorous standards.” j 

A third report. The State of State Standards, i 
(Finn, Petrilli, & Vanourek, 1998) is a com- | 
pilation and summary report by the \ 

Fordham Foundation analyzing the results i 

of the organization’s five separate studies of j 
state standards in English, history, geogra- \ 
phy, math, and science. According to the \ 
report, the potential for educational j 

improvement that begins by setting high I 
academic standards is theoretically a critical \ 
component in nearly every state’s efforts. j 
“Schools, teachers, and students will be held \ 
accountable for reaching them. Real conse- \ 
quences, hke the closure of a school, \ 

continued employment of a teacher, retention \ 
of a student, and salary of the principal might I 
result fiom reaching — or not reaching — these i 
state standards. Teacher training and certifica- I 
tion, curriculum and textbook selection, and j 
much else will follow firom such standards. I 
Thus, they have great potential for good or I 
for harm. Much depends on their quality.” \ 
The Fordham Foundation’s goal was to j 
find out whether state standards are rigorous * 
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and clear; readily accessible to teachers, par- 
ents, and students: and likely to boost student 
achievement. While some states did well in a 
few subjects, “the main conclusion to be 
drawn from this ambitious project is that 
most of the states have a long way to go 
before their academic standards will be 
strong enough to bear the considerable 
burden now being placed on them. Their 
present weakness, in fact, is a grave threat to 
standards-based education reform.” 

While the report concluded that state 
standards “are bleaker than we had hoped,” it 
also found “signs that American education is 
finally awakening to the need for rigorous 
standards, real assessments, and tough-minded 
accountability systems.” Like the AFTs Mak- 
ing Standards Matter, the Fordham Foundation 
did find a few states with “excellent standards” 
that can be used as models for other states. 
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^ Workplace Readiness 
and Industry Skill 



Standards 



The development of student stan- 
dards has also been taking place on another 
front in recent years, with efforts to define 
skill standards in areas beyond traditional 
academic areas, such as general workplace 
readiness, industry core, and job-specific 
skills. For instance, Hawaii has adopted 
“work skills” standards, Michigan has devel- 
oped model content standards for “career 
and employability skills,” and Oklahoma has 
developed content standards for “hands-on 
career exploration.” 

The National Skill Standards Act of 1994 



j established a board to oversee the develop- 
ment and implementation of a voluntary 
i national skill standards system, dividing the 
j economy into broad industry clusters. During 
j the past five years, six national skiQ standards 
pilot projects were funded by the US Depart- 
i ment of Labor and another 16 funded by the 
US Department of Education. The goal was 
j to organize stake holders and to develop 
industry-based skill standards. 

In Standards: Making Them Usejul and 
\ Workable for the Education Enterprise, Joan 
j Wills (1997) evaluates the effectiveness of 
j these efforts specifically for educators. For a 
i skiQ standards system to take hold in this 
nation, she found that state educational sys- 
j terns must be integraUy involved in the 
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development of “integrated curriculum, 
constructing career pathways information 
systems, engaging the private sector in STW 
efforts, and issuing certificates of competencies.” 
She recommended that states incorporate 
generic workplace skills into curriculum 
frameworks, include standards-driven criteria 
in the accreditation of secondary and post- 
secondary institutions, establish industry or 
occupational clusters for use with curriculum 
firameworks and career pathway information, 
and “establish a ‘single point of contact’ panel 
for skin standards development,” 

For most states, this effort to develop 
industry skill standards and assessments has 
been disappointing. No new standards have 
been released since the original 22 pilot 
projects were funded. And because the orig- 
inal projects used varying definitions of 
“standard,” few have resulted in any assess- 
ment mechanism. 

However, states have learned fix)m the 
process used to develop the standards. Many 
are adapting or adopting the relevant stan- 
dards into their own systems and are 
developing standards in are^ where sldll stan- 
dards still do not exist. 

Tying State Standards to 
" Student Assessment 
Systems 

What most of these reports forget 
to celebrate is that most states have standards. 
They are developing, analyzing, and imple- 
menting standards — a critical first step prior 
to assessment and curriculum development. 

This is a huge step forward fiom where 
states began when Perkins II was enacted. Yet 
according to Making Standards Matter, 1997, 
the standards are not yet strong enough in 
English, math, science, and social studies to 
build a solid foundation for the assessments. 

In addition, while most states would Hke their 
standards to be internationally competitive, 
many lack the resources to assess their stan- 
dards against that benchmark. 

In its study The Full Measure, Report of the 
NASBE Study Group on Statewide Assessment 
Systems, the National Association of State 
Boards of Education (1997) found that the 
widely varied assessment systems reflect the 
states’ individual priorities and unique con- 
text. Still, there are general characteristics 
“highly effective state assessment systems 
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share.” An eflfective system “is aligned with 
state standards; is designed to address specific 
goals and purposes; balances validity, reliabili- 
ty and efficiency; informs remediation and 
has consequences attached to some results; 
provides a firamework for school and district 
initiatives; and has a clearly articulated rela- 
tionship with national and international 
measures of student performance.” 

The study group also examined imple- 
mentation issues for state-level policy makers 
and oflfered the following “lessons learned.” 
These include having broad public engage- 
ment in the design and implementation of 
assessments, keeping the test development 
process open to public scrutiny, taking the 
time that is needed, and addressing critics 
while continuing to implement standards 
and assessment. The report also stressed the 
need for strong political leadership. 




Data to Improve 
Programs 



The issuing of education report 
cards and the reporting of student achieve- 
ment data are also part of state accountability 
reforms in the late 1990s that in some states 
influenced the evolution of their Perkins II 
accountability system. 

According to a recent SREB report. Link- 
ing Education Report Cards and Local School 
Improvement (Gaines, 1995), “school-by-school 
report cards are part of a move by states to 
shift the action fix)m the state capital to the 
local classroom by spotlighting student 
progress, or lack of progress in every school.” 
The earliest report cards included facts and 
figures about the state and school district such 
as student characteristics, finance issues, and 



student counts. Information about standard- 
ized test scores, performance on Advanced 
Placement examinations, and dropout and 
graduation rates are also included. Recendy, 
states have begun reporting student perfor- 
mance and achievement based on standards 
adopted by the state or district. 

Very few states have incorporated the per- 
formance of vocational education students 
into statewide, school-by-school report cards. 
Reports are aimed at measuring the perfor- 
mance of “all” students. States that have 
attempted to incorporate vocational educa- 
tion explicidy into the report card have 
reported out the performance of tech prep 




or non-coUege-bound 
s tuden ts . Vo cational 
educators are not neces- 
sarily comfortable with 
distinctions of college- 
bound and non-coUege- 
bound nor are they 
comfortable being left 
out. It is a difficult chal- 
lenge that will require 
further exploration in 
Perkins III. 

In addition, states 
that have school-by- 
school report cards are 
finding that simply pub- 
licizing the data isn’t 
enough. The informa- 
tion also must be used 
to boost student perfor- 
mance and to help school 
decisions and develop improvement plans. ! 

Some schools are much further along than j 
others in using data-based evaluation tools. j 
According to the SREB report, “most edu- j 
cators have little or no training in analyzing i 
a variety of data to make judgments about j 
the eflfectiveness of school programs." For j 
education report cards and accountability j 
reports to become useful in raising student j 
achievement, it’s clear that schools and j 

teachers must receive more support in inte- j 
grating their use in planning for school j 

improvement, and being able to improve j 
particular program performance (such as I 
vocational education programs) by using j 
general school report card data. j 




Mandates 



The accountability movement of the 1970s 
was driven by the mandate of education 
“inputs.” For example, states mandated edu- 
cation improvement by establishing 
requirements for school facilities, the age of 
textbooks, and credit requirements for high 
school graduation. 

In the 1980s, the emphasis shifted toward 
improving the preparation and training of 
teachers and principals. States examined 
teacher licensure laws, required teachers to 
pass examinations (usually set at minimal 
levels), improved teaching evaluation systems. 
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and introduced perfor- 
mance incentives for 
teachers. However, 
according to another 
SREB report, Account- 
ability in the 1990s: 
Holding Schools 
Responsible for Student 
Achievement (Cornett 
& Gaines, 1977), the 
“plans that eventually 
emerged re>varded 
teachers for longevity 
or extra work — not 
student success — and 
most were under 
funded and eventually 
abandoned.” 

In the 1990s, 
accountability shifted 
again, this time to the 
school level. The shift 
reflected state policy 
makers’ frustration 
with the modest 
improvements in student achievement dur- 
ing the 1980s and the realization that 
educational change and improvement is a 
complex process that must involve the 
whole school. 

According to the SREB report, as policy 
makers passed responsibility to the school 
level, educators were essentially told: “Here is 
the standard of progress you must achieve 
and here is the flexibility you need to get 
there.” In keeping with the emphasis on 
accountability at the school level, states have 
introduced sanctions and assistance programs 
for low performing schools in concert with 
policies to improve the quality of teacher 
education, licensing requirements, and con- 
tinuing professional development. 

Incentives for Students, 
Teachers, and Schools 

Another critical element of standards- 
based accountability is the importance of 
state level policies that motivate students to 
reach the higher standards. “If high standards 
and new assessments are going to make a 
difference in our schools, the results have to 




‘count.’ ” In 1996, the AFT first warned that 
state efforts to implement standards-based 
reforms would be severely hampered by the 
lack of rewards, consequences, or interven- 
tions. In 1997, the AFT found that only 
seven states were “seeking to end social pro- 
motion by requiring students to meet the 
state standards before being promoted into 
certain grades (up &om four last year).” Only 
13 states required that high school graduates 
pass assessments based on 10th grade stan- 
dards or higher, and only 13 required and 
funded intervention programs for low- 
performing students. 

When Perkins II was passed, it did not 
require that incentives and consequences be 
included with performance measures and 
standards. At the time, the concept of devel- 
oping an outcome-driven accountability 
system was too new, and many development 
and measurement issues remained to be 
solved. With more experience and political 
support, however, some states now include 
incentives and consequences in their 
accountability systems. While it is acknowl- 
edged that simply setting standards will not 
result in improved student achievement, 
there is yet no consensus on which incen- 
tives are most effective in motivating 
students. Thus, the targets of incentive pro- 
grams vary. What follows are examples of 
incentives for students, teachers, and schools 
from three states. 




Incentives for Students 

Along with other reforms cen- 
tered on standards, accountability, and 
assessment, in 1991 the Georgia Assembly 
began requiring all students to pass a new 
set of tests to receive a high school diplo- 



The Georgia High School Graduation 
Tests differed from the previously required 
Basic Skills Test by including social studies 
and science as well as reading, writing, and 
mathematics. The new tests “include 
process and application skills as assessed in 
a range of academic content, and shall 
exceed minimum and essential skills by 
extending the assessments’ range of difficul- 
ty,” according to the Georgia Department 
of Education. 
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According to the AFT, Georgia is one of 
only 13 states requiring students to pass exams 
based on tenth grade standards or higher. 
Geoi^a is one of only 20 states with gradua- 
tion exams linked to their standards, and is 
one of fewer than 10 states requiring students 
to meet standards in all four core subjects. 

Incentives for Teachers 

m Reform efforts in North Carolina 
have focused on improving the 
quality of teachers by investing in recruit- 
ment and salaries, improving teacher 
education training programs by requiring 
professional accreditation, strengthening 
licensing requirements, and offering mentor- 
ing programs for beginning teachers. North 
Carolina also oflfers incentives for experi- 
enced teachers to receive advanced 
certification through the National Board for 
Professional Teaching Standards. For state- 
paid teachers with a clear license and a 
minimum of three years teaching experience 
in North Carolina, the state will: 

• pay the $2000 assessment fee, 

• provide up to three days of paid 
release time, 

• grant renewal credit for teachers who 
complete all components of the portfo- 
lio assessment within the funded 
assessment cycles; and 

• pay National Board Certified Teachers 
a salary differential of 12% of their 
state salary for the life of the 10-year 
certificate. 

According to a report prepared for the 
National Commission on Teaching and 
America s Future, Doing What Matters Most: 
Investing in Quality Teaching Parling-Ham- 
mond, 1997), since introducing these 
changes, the North Carolina Department of 
Education says ‘ North Carolina has posted 
among the largest student achievement gains 
in mathematics and reading of any state in 
the nation, now scoring well above the 
national average in 4th grade reading and 
mathematics, although it entered the 1 990s 
near the bottom of the state rankings.” The 
state boasts the largest number of National 
Board Certified Teachers and is “home to 
207” of them. 
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Incentives for Schools 



The South Carolina School Incen- 
tive Reward Program began in 1984 
with a complex accountability sys- 
tem that included merit pay for teachers and 
principals. According to an official fiom the 
states department of education. South Caroli- 
na concluded that judging teacher merit was 
too difficult, and that the principal incentives 
v^ere driven by “building a file that showed 
what they did, but did not prove quality,” so 
merit pay was removed fiom the reward pro- 
gram. What did survive was the School 
Incentive Reward Program, which provides 
funds to schools with exceptional or 
improved student performance on two 
statewide assessments, one norm-referenced, 
the other criterion-referenced. Districts also 
receive incentive rewards if two thirds of their 
schools qualify. 

To qualify for a reward, schools must post 
one-year growth or meet the standard for 
improvement on the state’s tests. State- and 
nationally normed tests are used in grades 
3-1 1 in reading, mathematics, language, writ- 
ing, and science (not all in every grade). 
Ninety-eight percent of students must be 
included, and schools are awarded based on a 
formula that allocates schools to one of four 
different percentile ranges (95 or higher, 

90-94, 26-89, or 6-25) or whether the 
schools gain has been equal to or greater than 
the 65th state percentile rank for three years. 

In 1997-98, 291 out of 1015 schools 
received rewards ranging fix>m $2,800 to 
$72,400 on a per student basis. District 
rewards are $2 per pupil. While the typical 
amount per school is relatively small, about 
$15-25,000, schools are fiee to use the money 
for any instructional program enhancement 
chosen by a local school improvement coun- 
cil, with the exception of salary supplements 
or replacement of district funds. 

“The door is wide open, schools can pur- 
chase PE equipment, computers and software, 
furniture, decorative murals,” says an official j 
fiom the SC Department of Education. \ 

Schools also are given recognition by the • 

superintendent and a flag signifying their ! 
award. The program has lasted because the | 

money goes to the school as a community j 
which decides how to best use it to motivate i 
its own students. I 
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Next Steps: 
Perkins III 

The conversation about 
standards, assessment, 
data coUection and 
analysis has evolved 
since the passage of 
Perkins II in 1990. For 
the first few years, 
efforts in academic and 
vocational education 
were independent. But 
with an evolving 
national context and 
downsizing at the state 
level, recent efforts have 
been geared toward 
more integration or 
coordination at the 
state level. 

The requirements 
for core indicators of 

performance in Perkins III requires at a min- 
imum measures of each of the following: 

(1) Student attainment of challenging 
state-estabhshed academic, vocational 
and technical, and skill proficiencies. 

(2) Student attainment of a secondary 
school diploma or its recognized equiva- 
lent, a proficiency credential in 
conjunction with a secondary school 
diploma, or a postsecondary degree or 
credential. 

(3) Placement in, retention in, and com- 
pletion of, postsecondary education or 
advanced training, placement in military 
service, or placement or retention in 
employment. 

(4) Student participation in and comple- 
tion of vocational and technical 
education programs that lead to nontra- 
ditional training and employment. 

States may use previously developed per- 
formance measures that meet the above 
requirements. However, with the potential 
for incentive funding under Perkins III, all 
systems will need fine-tuning, and in some 
cases more serious work. We see four areas 
where more work needs to^|)e-done: 





Standards-Driven 
Assessment 

Although most states have estab- 
hshed some standards, most are a 
long way fix)m standards-driven assessment in 
academic, vocational/ technical, and work- 
readiness areas. States must work to create 
defensible, useful systems that provide the nec- 
essary data on student performance. In Perkins 
III “attainment” as oppose to “gains” is the 
operative word which may make this require- 
ment more manageable for some states. 

^ Integration 

Although some states have included 
vocational education in their overall 
accountability systems, many continue to iso- 
late “vocational” and “academic” reporting 
requirements. The result is dupHcation in data 
collection; multiple performance reports; 
incomplete information and, ultimately, frus- 
trated locals burdened by multiple and 
conflicting requests and requirements. In 
Perkins III, not only is it necessary to at least 
coordinate with academic “side of the 
house” to implement the first requirement, 
but the Act encourages collaboration with 
workforce development in implementing the 
new Workforce Investment Act. 

Tension in Purpose 

This push for vocational education 
to collaborate with many state and 
local dehvery systems does create a tension in 
purpose. In most states, vocational education 
is trapped between two often-conflicting ends 
of the spectrum: workforce development and 
school reform. On the one hand, vocational 
educators are attempting to be included (and 
in a few cases lead) in mainstream school 
reform through contextual learning, appHed 
methodology, and integrated curriculum. 
Vocational educators have become advocates 
for broad career knowledge and skills needed 
to improve students’ mastery of academic 
standards and to prepare them all for both 
postsecondary education and careers. 

On the other hand, vocational educators 
are also working with job-training and new 
welfare-to-work initiatives to help students 
obtain specific skills for entry-level work. This 
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training is more specific in focus and often 
shorter in term. These tensions exist in voca- 
tional education at both the secondary and 
postsecondary level and often complicate 
measurement systems, especially when mea- 
suring academic and occupational 
attainment. 

i I 

# Incentives and 
Consequences 

More research and development 
needs to be done in the area of incentives 
and consequences. State efibrts to implement 
standards— based reforms can be severely 



hampered by the lack of rewards, conse- 
quences, or interventions based on 
performance. The question becomes **What 
are appropriate incentives and consequences 
given the specific purposes on individual 
state systems?” Perkins III will provide an 
opportunity to experiment with one type of 
incentive through yet to be determined 
additional incentive money to states from the 
federal government. 

These are not simple issues, and they will 
require experimentation and fine-tuning to 
achieve desired results. 
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